Papers with multilingual embeddings
A Multi-task Approach to Learning Multilingual Representations (P18-2)
Copied to clipboard
| Challenge: | Using a multi-task model, we learn word and sentence embeddings in a single task. |
| Approach: | They propose a multi-task modeling approach that trains a skip-gram model and a cross-lingual sentence similarity model to learn word and sentence embeddings together. |
| Outcome: | The proposed model can learn word and sentence embeddings in a multilingual distributed representations of text using a cross-lingual sentence similarity model. |
SimAlign: High Quality Word Alignments Without Parallel Training Data Using Static and Contextualized Embeddings (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Word alignments are useful for statistical and neural machine translation (NMT) and cross-lingual annotation projection. |
| Approach: | They propose to leverage multilingual word embeddings for word alignment. |
| Outcome: | The proposed methods perform better for four languages and comparable for two languages than traditional statistical aligners even with abundant parallel data. |
Multilingual Factor Analysis (P19-1)
Copied to clipboard
| Challenge: | Existing methods for multilingual word embeddings are based on the observation that word embeds exhibit similar structures across languages. |
| Approach: | They propose a latent variable-based model that fits a multilingual dictionary to learn multilingual word representations offline. |
| Outcome: | The proposed model is robust to noise in the embedding space making it suitable for distributed representations learned from noisy corpora. |
XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | XTRA aims to uncover shared semantic themes across languages . previous methods have achieved improvements in topic diversity but struggle to ensure high topic coherence and consistent alignment across languages. |
| Approach: | a new framework unifies Bag-of-Words modeling with multilingual embeddings is proposed to address this problem . XTRA introduces two core components: (1) representation alignment and (2) topic alignment to enforce cross-lingual consistency. |
| Outcome: | XTRA outperforms baselines in topic coherence, diversity, and alignment quality on multilingual corpora. |
Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models (P19-1)
Copied to clipboard
| Challenge: | Existing methods that map word embeddings into a common space without any parallel data or pre-training have been proposed that are limited in resources and perform poorly under resource-poor conditions. |
| Approach: | They propose a model that maps monolingual word embeddings into a common space without any parallel data and generates multilingual embeddables without any pre-training. |
| Outcome: | The proposed model outperforms existing methods on word alignment tasks on low-resource conditions and with limited resources. |
A Multilingual BPE Embedding Space for Universal Sentiment Lexicon Induction (P19-1)
Copied to clipboard
| Challenge: | Existing methods for sentiment lexicon induction are limited to low-resource languages. |
| Approach: | They propose a method for sentiment lexicon induction that is applicable to the entire range of typological diversity of the world's languages. |
| Outcome: | The proposed method is applicable to the entire range of typological diversity of the world's languages. |
Exploring Alignment in Shared Cross-lingual Spaces (2024.acl-long)
Copied to clipboard
| Challenge: | a new study examines the degree of alignment between languages in multilingual embeddings . cross-lingual embeds are designed to encode linguistic concepts that bridge equivalent semantic meaning . a comprehensive approach is needed to address these questions. |
| Approach: | They employ clustering to uncover latent concepts within multilingual models . they introduce two metrics to quantify alignment and overlap of these concepts . |
| Outcome: | The proposed model can capture linguistic nuances across languages, but is not language-agnostic? the proposed model is able to capture nuances in multiple languages, the authors say. |